SPLINE APPROXIMATIONS FOR NONLINEAR 


HEREDITARY CONTROL SYSTEMS 

{NASA-CH- 172764) SPLINii APPitOXIMATIOMS PCfi N83-33590 

NOKLINEAfi HEt£DIXAKX COAXfiOL SYSTEMS (NASA) 

54 p HC A04A'lf AOl CSC! 12A 

UfiClas 
G3/64 10976 

P. L. Daniel 


Report No. 82-10 




nr,T n Wl 

languey research center 
LIBRARY. NAS| 
HAM'’TOM.V>RGtklA 


INSTITUTE FOR COMPUTER APPLICATIONS IN SCIENCE AND ENGINEERING 
NASA Langley Research Center, Hampton, Virginia 23665 


’ Operated by the 



UNIVERSITIES SPACE 


RESEARCH ASSOCIATION 



SPLINE APPROXIMATIONS FOR NONLINEAR 


HEREDITARY CONTROL SYSTEMS'*' 


*.v 

P. L. Daniel 

Southern Methodist University 
ABSTRACT 

A spline-based approximation scheme is discussed for optimal control 
problems governed by nonlinear nonautonomous delay differential equations. 
The approximating framework reduces the original control problem to a 
sequence of optimization problems governed by ordinary differential 
equations. Convergence proofs, which appeal directly to dissipative-type 
estimates for the underlying nonlinear operator, are given and numerical 
findings are summarized. 
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§1 Introduction 


The focus of our efforts here is to extend the results of Banks in 
[3] to spline-based approximation schemes for control systems governed by non- 
linear nonautonomous functional differential equations (FDE). Our ideas are 
similar to [3] in spirit in that we approximate infinite-dimensional FDE 
systems by finite-dimensional ordinary differential equation (ODE) systems. 

(This approach is not new to the treatment of control problems; a fairly 
thorougn summary of the literature may be found in [6].) 

Our results improve upon the findings of [ 3 ] (as well as the linear FDE 
results in [lO], [5], [6] and the nonlinear autonomous findings of [21]) in 
that we handle very general nonlinear nonautonomous FDE systems that may contain 
nonlinear discrete delay terms (i.e., terms involving x(t-r)); in [3], discrete 
delay terms could only appear in the linear autonomous part of the control system. 
Additionally, our approximations are based on linear splines which have generally 
demonstrated superior performance when compared in [lo] and [7] to the averaging 
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approximations treated in [3]. Furthermore, we adopt a moro direct theoretical 
aporoach than that of [3]. In the latter, the nonlinearity is treated as a 
perturbation of a linear system (which is formulated as a linear semigroup 
problem) and Trotter-Kato convergence results are invoked to demonstrate the 
convergence of approximating semigroups. Our ideas are in the spirit of [4 ], [8], 
and [9] where convergence is demonstrated through a direct application of 
dissipative-type estimates to the underlying nonlinear operators. This 
straightforward approach easily accommodates both nonlinear and nonautonomous 
systems, differing from such recent studies as the examination of linear non- 
autonomous FDE systems in [11] via an evolution operator analogue of the 
Trotter-Kato theorem, or the consideration in [19], [20] of nonlinear autonomous 
equations using a nonlinear Trotter-Kato type result. 

Disadvantages of our treatment of FDE-governed control problems are that 
we require additional smoothness hypotheses on the right-hand side of the FDE 
and we must consider a restricted class of controls: Specifically, we will' 

limit our attention to controllers with inertia, or those controls with restrictions 
on the rate at which they may be varied. Although such a restriction is not 
unreasonable in many applications fsee the wind tunnel example in §4i information 
on relevant mechanical and economic systems may be found on pages T20-123 of [13]) 
it represents a limitation not found in the previously mentioned papers. 

Our presentation is as follows: In section 2 we describe an optimal control 

problem for nonlinear FDE systems and present an equivalent Hilbert space 
formulation based on an abstract nonlinear evolution equation. Approximating 
spline subspaces are constructed in section 3, where approximate control problems 
are defined and convergence results are detailed. Finally, in section 4 we 
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present numerical findings for several examples where the spline approximations 
have been used to estimate the control and state variables. 

Much of the notation is standard and in accordance with popular usage. 

Since most functions considered will be Fi'^-valued, we will designate by H^(a,b) 
and Lp(a,b) the corresponding Sobolev and Lebesgue spaces of R’^-valued functions 
defined on (a,b); similarly, the spar.- C^([a,b];R”) of n-vector valued functions 
on [a,b] with m continuous derivatives will be denoted by c"’(a,b). For a square- 
integrable function s -> x(s) e the notation x^ will designate the LgC-r.O) 
function given by x^(0) = x(t+e), - r £ e £ 0, where r > 0 is fixed throughout. 
Finally, we shall not distinguish between the column form of a vector and its 
transpose, and the same symbols I*! (and <•,•>) will be used to denote any of 
several norms (and inner products) for L 2 , and Z = r" x L 2 when the meaning 
is clear from the context. 

§2 The Nonlinear FDE Control Problem 

In the present section we describe the nonlinear nonautonomous FDE control 
problem that is the focus of this paper, and outline the properties that will be 
employed in subsequent sections. Our approach in §2.1 is to reformulate the 
FDE-governed control problem as an abstract problem on an infinite-dimensional 
state space. In Theorem 2.3, the result that concludes the section, we guarantee 
the existence of a control that minimizes the quadratic cost functional and 
generates a solution to the nonlinear FDE. 

The control problem examined in this paper will be limited to a class of 
problems involving inertial controllers, i.e., those controls with restrictions 
on the rate at which they may be varied. The control problem considered here 
(referred to hereafter as P) may be formally stated as follows; 



4 


0R«KAL mm m ■ 

OF POOR QUALIW 

Find an optimal control u £ U, where U is defined by 
U = {u e H^((a.b);R'") lu{a)l < K} 

(K a fixed constant), that minimizes the quadratic cost 
functional J(u), 

J(u) = (x(b) - K(0))QQ(x(b) - k(0)) 

0 

+ / (X|j(0) - ic(e))Q^(xjj(0) - <(0))d0 

b 

+ / x(t)Q2x(t)dt 

b 

+ / {u(t)^^u(t) + u{t)Su(t) }dt. 
a 

Here (k(0),k) is a given "target" in x L2(-r,0), ^ 0 are nxn matrices 

(i = 0, 1, 2), R and S are mxm matrices with R ^ 0 and S > 0, (without loss of 
generality Q^, R, and S may be assumed to be symmetric), and the pair (x,u) 
satisfies the vector nonlinear FDE 

x(t) = f(t,x(t),x^,x(t-r^), x(t-r^)) + B(t)u(t), a < t £ b, 

( 2 . 1 ) 

(x(a),x ) = (<!>(0),(!>). 

We shall assume that B e H^((a,b);R"^"’), the initial data (<|)(0),<!)) is such that 
ii e H^(-r,0), and the discrete delays satisfy 

0=rn<r, <...<r =r; 

0 1 V 

in addition, f satisfies the following standing hypotheses. 
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(!il) The mapping f satisfies a global Lipschitz condition on x L2(-r,0) x 
That is, there exists e L 2 ((a,b);R), > 0, such that for all 

( 5 » *1* , • • • , 5 »x>y'j > • • • ) E R ^ L2 (”'^j0) X r , 


j f ( 1 1 ^ , t|i , w-| , . . « , ) “ f(t,6,x,yi 
for almost all te[a,b3. 


»y^)l 1 + |i|/-xl + .I^lw^-y^!} 


(H2) The function f is differentiable on x L2(~r,0) x 

(H3) The mapping -+ f^(a,ip(0) ,i|«,i;)(-r^ ) , . . , , i/»(-r^)) is continuous 

from [a,b] x C(-r,0) to R^. 


Remark 2.1 It is an immediate consequence of hypotheses (HI) that f 
satisfies an affine growth condition; that is, for x given in L 2 (a-r,b), 

(2,2) |f(t,x(t),x^,x(t-r^),...,x(t-r^)) j ^ 

£ m^(t){|x(t)! + lxj.1 + nx{t-r.)l} + m 2 (t), 

where m 2 (t) = | f(t,0, . . . ,0) [ is in L 2 ((a,b);R) from (H2). Quite standard arguments 
may then be employed to demonstrate that t f (t,x(t) ,x^,x(t-r^ ) , . . . , x(t-r^)) is 

in L-j(a,b) and that the mapping depends only on the equivalence class of x. There- 
fore, since we shall only consider (2.1) in its equivalent integral form, there 
will be no difficulty associated with the point evaluations of x appearing in f. 

Remark 2.2 Assumption (H3), which is required in the proofs of Lemma 3.2 and 
Lemma 3.4, may actually be reolaced by a weaker hypothesis: 


(H3') For X e E, E boiinded in C(a-r,b), the mapping 

a -> f.(.(a,x(a) ,x^,x(o-r.| ) , . . . , x(a-r^)) is dominated by a 
L 2 (a,b) function, uniformly in x s E. 
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Remark 2.3 It is not difficult to prove that the set U of admissible controls is 

convex and closed in ((a,b) ;ff’) . In addition, we remark that although u e U has 

been defined without constraints on the LgCa.b) norm of its derivative, it is clear 

that any optimal control u (0(u)< » ) must satisfy |uj < » , 

Before we consider the problem of locating an optimal control u e U, we 

shall first establish the existence, uniqueness, and continuity properties of 

solutions to (2.1) for any given u in U, In the theorem that follows we state 

these results without proof, since the arguments required involve quite 

standard applications of uniform contraction principles ([18], p. 7), hypothesis 

(HI), and the growth condition (P.2) (see §1.3 of [14] for details). 

Theorem 2.1 There exists a unique (continuous) solution x to (2.1) on the 

1 1 m 

interval [a-r,b] which depends continuously on {!i)(0) ,<|) ,u} e r'^ x H (-r,0) x H ((a,b);R ) 
in the r” x L 2 (-r, 0 ) x L 2 ( (a,b) •,r'") topology. 

§2.1 An Abstract Reformulation of the Control Problem 

We next establish an equivalence between the nonlinear nonautonomous FOE 

(2.1) and an abstract evolution equation (AEE) in an infinite-dimensional state 

variable. The abstract framework established in the present section is similar 

in spirit to [lO] and [3] and is well-established in the FDE literature (see, 

for example, [6] and the references therein). 

The state space will be defined to be the infinite-dimensional Hilbert 

space Z = r'^ X Lp(-r,0) with norm [•[ induced by the inner product 

<(Cj'I') >(5,x) >= ^6 + tx- For (t,5,i|)) in [a,b] x x C(-r,0) we define 

-r - 

F(t,z,ip) = f(t,5,-^,t(-r^),... ,!}<(-r^)) and A(t) : W Z by 
(2.3) A(t)('H0),'P) = (F(t,.l,(0),-J;), t?o) 

where W = {(i|j( 0) ,i|^) e Z j tp e H^(-r,0)}, and 9-p denotes the L 2 (-r, 0 ) function 
that is the derivative of .p. 
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Details of the reformulation of (2.1) as an equivalent evolution equation 
on Z may be found in [8], where the same FDE is examined in the context of a 
parameter estimation problem (where coefficient parameters as well as delays 
ri»...,r^ and initial data (<J>(0),4>) are unknovm). The results in section 2 of 
C 8] may be readily extended to the FDE control system under consideration here; 
we state those findings in Lemma 2.1 and Theorem 2.2. The first of these results 
describes how to construct an equivalent topology for Z so that the nonlinear 
ooerator A satisfies a dissipative-type inequality. The lemma, a nonlinear 
analogue of similar estimates found in [6] and [10], greatly simplifies our 
calculations and is the foundation for our theoretical development without the 
use of semigroups. 

Lemma 2.1 Let y = (5,>i)) and z = (6,x) he given in Z and define a new weighted 

0 , 

inner product on Z by <y,z> = + f tij(9)x(0)p(0|d9 where p is given on 

F -r 

[-r,0] by 

(2.4) p(9) = i 2, 9 e 

V, 9 e [-r-1,0]. 

Then <A(t)y - A(t)z,y-z> <_ u(t) |y-z 1 ' for all y ,2 e W and almost all t e [a,b]. 

3 V V 2 

The function u > 0 is in L^((a,b);R) and is given by u(t) = m.j(t) j * J 

The equivalence of the FDE (2,1) to an evolution equation in z(t) e Z is,- 
established in the next result. 
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Theorem 2.2 Let y(t;c,u) = (x(t;c,u) ,x^(c,u)) , where x is the solution to 
(2.1) corresponding to c = ((i)(0),i|i) e W and u e ((a,b) ;R"’). Then y(t,u) Is 
the unique solution on [a,b] to 

t 

(2.5) z(t) = C + / {A(a)z(o) + (B(o)u(a) ,0) }da, 

a 

for (B(CT)u(a),0) e Z. Furthermore, y(t;?,u) e Z is continuous in t c [a,b] and 
uniformly continuous in {t,u} e W x H\(a,b);R’’’) (in the Z x l2((a,b) jR*^) 
topology) uniformly in t e [a,b]. 


Remark 2.4 Although we have established an equivalence between an FDE (in the 
finite-dimensional state variable x(t)) and an AEE (in the infinite-dimensional 
state variable z(t)), the infinite dimensiorality of the latter is actually 
inherited from the FDE in that the L2(-r,0) history of x on [t-r,t) is required 
before the solution x to the FDE may be determined at t. Thus any computational 
difficulties associated with (2.5) are not due to the approach we have taken here 
but, rather, may be traced to the inherent infinite dimensionality of the under- 
lying FDE. 

In view of the equivalence established between the FDE and the AEE dynamical 
systems, we may now restate the control problem P in this abstract setting. That 
is, we wish to find a control u" e U that minimizes 

(2.6) J(u) = (nQz(b;u) - k(0) )QQ(nQz(b;u) - k(0)) 

0 

/ (JI,z(b;u) -ic)Q^(n^z(b;u) - K)(9)d0 
- r 

b 

+ / (nQz(t;u))Q2(nQz(t;u))dt 
d 

b 

+ / {u(t)?^(t) + u(t)Su(t) }dt, 
a 
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where Hq : Z -»• r” and : 1 LgC-rjO) are defined by nQ(§4) * 5 and 
and z(t;u) satisfies the AEE (2.5). Several properties of P important to the 
development in §3 are summarized in the following theorem. 


Theorem 2.3 . Let be given In U, k = 1,2,, 


Then 


(1) the cost functional J(uj^) -»■ » if luj^l -»■ », 


1 , 


(11) the functional J is weakly lower semicontinuous on H'((a,b);R"’), and. 


(ill) the control problem P has a solution in U. 

Proof : Trivial arguments establish (1). For (11), we will let {Uj^} e be given 

1 m 

such that U|^ converges weakly to some u in H ((a,b);R ), and establish that 

J(u) llim.J(u.). Rellich's Lemma (the injection of Into L2 
k-vra 

is compact; see, for example, [16]) may be employed to obtain strong convergence 
of U|^ to u in L^ so that we may utilize continuity properties of z to claim that 
z(t;Uj^) z(t;u) in Z, uniformly in t fTheorem 2.2). It immediately follows that 


(ngZ(b;U|^) - K(0))QQ(nQz(b;U|^) - <(0)) ^ 

(HQz(b;u) - K(0))QQ(r[gZ(b;u) - k( 0)) in R , 

(n^z(b;Uj^) - K)Q^(ii^z(b;u,^) - <) ■> 

(’[^z{b;u) - K)Q^(n^z(b;u) - k) in L^ ((-r ,0) ;R) , 

and, for t e [a,bl, 

(ngZ(t;U|^))Q2(ngZ(t;U|^)) -»■ (HgZ(t;u))Q2(nQz(t;u)) in R, 
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In fact, the last convergence is aominated because we may find Cq e R such 
that 

! (^o^C t jUr) )Q 2(nQz( t )) j ^ Cq IQ 2 I 

due to the fact that (t,v) -»■ nQz(t;v) is continuous and hence bounded on the 

compact set [a,b] x V, where V = 

The remaining terms in J are 

b b 

/ u(t)Ru(t)dt + / u(t)Su(t)dt. 
a a 


We note that for any positive semidefinite m x m matrix K, the mapping v |v]j^ 
def i ned by 

b 

|v||^ = / v(t)Kv(t)dt 

3 


is continuous with respect to the Ip norm and, due to Its convexity properties, 
it is also weakly lower semicontinuous on L 2 (Mazur's Theorpm; see [15], p. 422; 
[2], p. 30). Hence ^ |u|j^ since u in L 2 and (uL £ lim [uj^L 

k->-oo 


since u, 


u i n L 


2 * 


The proof of (ii) is complete. 


(iii) Since 0(u) 0, there exists a ^ 0 such that a = inf J(u) = lim J(u. ) 

ueU k-+«> 

for some sequence {Uj^} in U. We must have [Uj^l <_ for some 0; otherwise. 



' ■ f'<v ?-:vi '.V 

there exists a subsequence {u.} such that 
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OF POO? QUAUTY 



® and r 


= lim J(m. ) * «, 


contradicting a £ J(v) < <» for any v e u. 

Finally, making use of the bounds, _< Kq and jUj^(a)| 5 K, wc estat.lish 
that {U|^} is bounded in so that {Uj^} must have a subsequence u,^. con\erging 


weakly to u in ( (a.b) ;R”’). In fact, IT is in U since U closed and convex 
implies that U is weakly closed in ([2], p. 30). The observatior that u is 
a solution to the control problem P follows immediately from the lower semi- 
continuity of v] since 


® 1 1 T ill J(U|. ) - a. 



§3 Approximate Optimal Control Problems 

Our objective in this section is to construct a sequence of control problems 

M 

P , each of which depends on a finite-dimensional ordinary diFferential equation 
(ODE), that will serve to approximate P, a computationally difficult cc trol 
problem governed by an FDE (an infinite-dimensional state equation). Conventional 
optimi;:ation techniques may then be applied to P^. applying standard OOF software 
schemes each time a solution to the state equatif' Is required. Although the 
'approximation framework we deveioo is based on linear splines, an extension of 
these ideas to arbitrary order splines is easily accomplished by adding additional 
smoothness hypotheses on f and making minor modifications in the arguments given 
below (see the theory developed in [10] on which all of our work here is based). 



N 

For N = 1,2,..., we shall define the linear spline subspace Z of Z by 

M 

Z = {(<|<(0) ,ij;) e Z I is a piecewise linear spline with knots 
at tj = - j|-, j = 0,1,...,N} , 

and the orthogonal projection (in the topology) of Z onto Z^ along 

will be denoted byP*^, The nonlinear operator A^(t) : Z -► Z*^ will be defined by 

A*^(t) = P^A(t)P*'* for t E [a,b]. We remark here that A^(t) is well-defined since 

P*^Z cW, W the domain of A(t); in addition, A*^(t) may acutally be viewed as an 
N N N N N N 

operator on Z because P z = z for any z e Z . We may now define "approximating" 
M 

equations on 2 , N = 1,2,..., by 

(3.1) z^(t) = P^i; -i* / {A^(CT)z*^(a) + P^(B(a)u(a) ,0) }da, a £ t _< b, 

a 

N 

each of which may be replaced by an equivalent ODE on Z , 


(3.2) 


fz'^(t) = A^(t)z'^Ct) + p'^(3(t)u(t),0),‘ a < t < b 


n N 

Since Z‘ is finite-dimensional (each element of Z is completely determined 

N 

by its value at N+1 knots). Corresponding to the new state spaces Z and 
"approximating" equations on Z*^, we may define an "approximate" control problem 
for each value of li. We shall let denote the problem of finding IT e U that 

minimizes 0*^(u) over all u e U, where the "approximate" cost functional is 
defined in a natural way from the form of J in (2.6): Let 
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,N 


J"(u) = (nQZ^(b;u) - K"(0))QQ(nQZ^b;u) - k”(0)) 

+ /°(n^z^(b;u) - K^)r (n^z^(b;u) - K”)(e)d 0 


» V. 


OF ^ 


N/ 


+ / (nQz’^(t;u))Q2(nQz'^(t;u))dt 
b 

+ / {u(t)Ru(t)dt + u(t)Su(t) }dt, 
a 


where (k*^(0), k^) = P^(k(0), k) e and t -+• z^(t;u) denotes the solution to 
(3.2) corresponding to u e U. 

At this point it is appropriate to characterize properties of A^(t), P^, 
and solutions to (3.2); it is not surprising that most of these properties are 
inherited from their infinite-dimensional counterparts in §2.1 and §2.2. 


Lemma 3.1 Let y and z be given in Z. Then 
<A^(t)y - A^(t)z, y-z> <io(t)|y-zl^ 

p — ‘ 'p 

for every N and almost every t s [a,b]. Here u is defined as in Lemma 2.1 by 
iu(t) = I m^(t) + f + I m^(t). 

Proof : The result follows immediately from the same dissipative-type estimate 

on A(t), because 

<A'^(t)y - A*^(t)z, y-z>p 

= <p’'*A(t)P% - p'^A(t)P^z, y-z>p 
= <A(t)P^y - A(t)P^z, P^y - P^z>p 
1 u(t) 1 p\ - P^zlp 
< -.o(t) I y-z|^ 
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Theorem 3, 1 Let c = (4i(0),(fi) e W and u e U be given. Then there exists a 
unique solution t-j“Z^(t;c.u) e to (3.2) continuous on [a,b] with the property 
that the map . 

{C.u} z*^(t-,i;,u) 


is uniformly continuous (in the Z x L 2 ((a,b) jR"”) topology) uniformly in N and t. 


The proof of this result may be found in [8] in the context of a parameter 
estimation problem and will not be detailed hi^re; the idea is to use a Galerkin- 
type procedure to rewrite (3.2) as an ODE in spline basis coefficients of z (t), 
so that we obtain existence, uniqueness, and continuous dependence of solutions 
through an application of conventional ODE theory. For future rsferance, we 
briefly describe the linear spline basis elements and the ODE in the basis 
coefficients, although we refer the reader to [8] for the details of this con- 
struction (which is in the spirit of [10]). In the case of .the scalar equation 
(where Z^ c x L2((-r,0) ;R^)), linear spline basis elements are given by 


= (e|(0),e'J), j = 0,l,...,N 
J J J 

where e^ is the piecewise linear spline in Z*^ characterized bye>(t*^) = 6.., 
the Kronecker delta symbol. Then any function z*^ with z*^(t) e Z^ can be written 

z^*(t) = I w^(t)e!|, where w^(t) e *, extending to Z^ c x Lo(-r,0), we have 
j-Q ■ J J J ^ 


z vt) “ 2 w.(t)e. where now w.{t) e In either case, the ODE in the 
j=0 J J ^ 

n(N+l )-vector w^(t) = col ( wq( t) , . . . ,w^( t) ) of basis coefficients becomes 
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i"(t) =. [Q")-’(f(t ,w"(t), I w"(t)e” I w^{t)e"(-r,). 

U j*0 ^ ^ j=0 ^ J ^ 


(3,3) < 


N 

..., [ w^(t)e’J(-r )) -!• B(t)u(t),0.,...,o)^ 


+ a < t <. b 


L w^(a) = 


where . . ,?!!) is defined by The n(N+l )-square 

j =0 '* ^ 

matrices o'"’ and are given by q”^. = 8^^(0)V(0) + / s'^(9)^e’^{e)p(e)de, with 

-r 

s'* = (Cq ® ^ represents the nxn identity matrix,-© denotes the- 

Kronecker product, and 


IZ 


•N N 


• N N 


<ej^.eQ> 


© I, 




where here <-,•> denotes the p-weighted L2((-r,0);R^) inner product. For 
N N 

N = 2,3,..., both Q and ^>sve simple three-band matrix forms, exhibited 
here for the special case of v = 1 (so p(e) = 1): 
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Theorem 3.2 Let U|^ be given in U, k = 1,2,., . . Then 

(1) the cost functional ->• « if |U|^| " 

(ii) the functional is weakly lower semi continuous on ((a,b) , and, 

(iii) P has a solution in U. 

§3.1 Convergence of State Variable Approximations 

From our findings in the preceding sections we are guaranteed the existence 
of a sequence of optimal pairs z^'Cu''*))} where each u^is a solution to 

V and z (u ) is the optimal solution to (3.2) corresponding to u . We have 
yet to establish that the sequence of pairs converges in any meaningful sense 
to (UjzCu)) where u is an optimal control for the original control problem P 
and zCiT) is the corresponding solution to the original AEE (2.5). Fundamental 
to this endeavor is the requirement that the approximate state variables 
z (t;u) converge to z(t;u) uniformly in u e U , where U is a suitably restricted 
subset of U. To motivate the definition of u\ we remark that one of our 
objectives is to demonstrate the convergence of J^(u*^) to J(1J), so that an 
approximate cost may be computed for M sufficiently large (it is actually 0(0*^*) 
that is important in practice but it too is approximated by J^(u*^) ). To this 
end, any sequence of controls ,• where 17^* is a solution to P^*, must be 
characterized by the property that |u | £ M, for some M > 0, or we will obtain 

M M JLm 

d (u ) -»■ ra as ju I It is not unreasonable then to want to prove state 

variable convergence uniform in u e e {u e U [uI^M}. 

M 

In what follows v/e will establish that solutions z (c,g) to 

(3.4) z^(t) = + /{A^’(a)z^(a) + P^(g( 0 ) ,0) Ido, 

a 
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N = 1,2,..., converge to z(c,g) the solution to 

t ■ 

(3.5) z(t) = 5 + / {A(a)z(a) + (g(a) ,0) }dcr 

a 

uniformly in g e A = {g e H^(a,b) lg(a)l £ , |gj < K 2 > for all t e [a,b] 

and c e W. (There will be no difficulties encountered in replacing g(c) by 
B(t)u(t) when we return to the control problem formulation.) Our approach will 
be in the spirit of [ 8 ] where convergence is first uemonstrated for {c,g} in 
a smooth subset of W x a. 

2 

Define S = {(<|;(0) ,ijj) e Z [ e H (-r,0)}. For any constant M 0 and 
t = (iji(0),‘>) in S, let I(c,M) be given by T(c,M) = {g e H^a.b) lg[ <_ M and 
g(a) = ^(0) - F(a,({i(0) Convergence of z^(t;?,g) to z(t;c,g) is not difficult 

to show if ? is chosen from S and gel (c,M), because z(t;c,g) will be sufficiently 
smooth to allow use of certain standard spline estimates. These remarks ar'e 
summarized in the two rather technical results that follow. 

Lemma 3 . 2 (i) For any M ^ 0, the solution t-i-z(t;c,g) to (3.5) corresponding 

to ^ e S and g e I(c,M) is such that zft) g S for all 
t e [a,b]. 

(ii) S is dense in W. 

The proof of (i) requires hypotheses (HI) - (H3) and is presented in detail 
in Lemma 3.2 of [8 ] (the arguments are applicable here because c e S and 
g G lUJi) implies that the pair {c,g} c I, where I is defined in [8 ] and differs 

from I(^,f1) defined here). Part (ii) of the lemma is a standard result from the 
theory of Sobolev spaces. 

If z = (i{»(0),ii)) is sufficiently smooth, standard spilire results (see, for 
example [27], [28]) may be invoked to characterize the o.nller of convergence of 
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HI w N 

to ^ and to P^ii, whore i|)j is the interpolating linear spline function 

(with knots at t*?)' for The convergence rates outlined in the lemma that 
J 

follov/s are established in [10], [8] and are derived from these spline esti- 
mates and the' fact that jP^'^z - zj^ £ Kti/jCO), j) - zj^ for all N. 

Lemma 3.3 Let z = (il/CO) ,i|;) he given in S, and denote by (!j<^(0) the 

element P^^^z of Z^. Then the following estimates may be obtained for N sufficiently 

large: 

(3.5) jP^'’z-zj 

P 

fc 

(3.7) < -jf 

h 

(3.8) l/(o) - ti)(e)l i( 4 + ) \v^i>\, -r < ® < o, 

where k-j and k^ are positive constants- independent of fl. 

lie now consider the problem of demonstrating the convergence of z*'*(t;c,g) 
to z{t-,z,g) uniformly in g e A. To this end, we establish preliminary estimates 
that facilitate the uniform convergence proofs. 

Lem ma 3.4 Let M ^ 0 and ^ = (a(0),(I>) e S be given, and let t •+ z(t;g) = 

(x(t;g), x^(g)) denote the solution to (3.5) corresponding to 5 and g e I(^,M), 
t £ [a,b]. Then 

(i) the mapping 

(t,g) -> A(t)z(t;g) = (p(t,x(t;g) ,x^(g) ),Px^(g)^ 
is continuous from Rx L2(a,b) to Z, and. 
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(1i) there exists a constant k = k( 5 ,M) > 0 such that 

|P%(g)llk 

for all g e I(?,M) and almost all t e [a,b]. 


Proof : To establish (i), we demonstrate first the uniform continuity of the 
map 

(3.9) (t.g) F(t,x(t;g),x^(g)) 

from R X L 2 (a,b) to Z for (t.g) e [a.b] x l(?,M) (here I(c,M) denotes the 
closure of I(t,M) in the L 2 topology). Since I(c,M) is bounded in H (a.b), 
(and thus the set is precompact in L 2 (a,b)), the continuity of z in t and g 
established in Theorem 2.2 guarantees that ’ 


|^(t, x(t;g) ,x^(g) ,x(t-ri ;g) ,. . . ,x(t-r^;g) ) 


t£ [a.bl.geiT? 


;mt] 


is compact in R x Z x Hypothesis (H2) may be invoked to complete the 

arguments needed to obtain uniform continuity of the function given in (3.9). 

To complete the arguments for (i), let e > 0 be given and let g, g' be 
chosen in I(c,M) such that |g-g'| <6, <S = 5(e). It follows that 




uniform in t. Finally, the continuity of A(t)z(t,g) in the pair (t,g) follows 
from an application of the triangle inequality: For (t,g) and (t',g') in 

[a,b] •-< 
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|A(t)z(t;g) - A(f )z(f ;g')|^ 

P 

<.2[A(t)z(t;g) - A(u')z(t';g)|p 
+ 2lA(t')z(f ;g) - A(t')z{t'*,g')l^ 

p • 

< 2lF(t,x(t;g),x^(g)) - F(t’ ,x{f ;g) ,x^< (g)) 

0 . . o 

+ 2v / |x(t+9;g) - x{t’+ 0 ;g)pd 0 

-r 

+ 2|A(f )z(t';g) - A(f )z(f ;g' ) 1^ , 

where the first and third terms may be made arbitrarily small us'ng the previous 
arguments. In addition, the middle term is small for jt-t' 1 small since 

t 

Lemma 3.2(1) may be used to demonstrate that x is uniformly continuous in 
t e [a-r,b]. The desired continuity of 

(t,g) A(t)z(t;g) 

than obtains. 

2 

(i-’) Let M be fixed and consider \V x^(g)| for all g e The 

differentiability of f (assumed in (H2)) yields 

x(t) = f^(t,x(t),x^,...) + f^(t,x(t),x^,...;x(t) 

+ f^[t,x(t),x^,...; Xj.] 

V 

+ I fw (t,x(t),x^,...)x(t-r ) + g(t) 

1=1 ^1 

for t e (a,b), where f. denotes the Frechet derivative of ) 

0 I V 

with respect to 5, 6 = o,c,t.yp ■ • • >.v,^- The global Lipschitz property for f 
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ensures that these derivatives (excluding f^) are bounded, so that, for almost 
all t e (a,b), 

lf^(t,x(t),x^,...)x(t)| < m^(t)lx(t)| 

I ^j^Ct,x(t),x^,...j x^3 1 ^mi(t)|x^|j 

v;e obtain similar estimates for fy.. Thus, 

•^i 

(3.10) |x(t;g)| £ lf^(t,x(t) ,x^,. , . ) | + m^(t)(l+r^^^ + v)L + |g(t)I 

almost everywhere on [a,b] for L = sup {|x(t;g)|; te [a-r,b], g e l'(c,M)}. 

That L is finite is easily obtained from the fact that x = on [a-r,a] and, 

for t e (a,b], 

lx(t;g)| 1 lF{t.x(t,g),x^(g))| + lg(t)|, 

where the first term is bounded (uniform in t and g) from arguments developed in 
the proof of (i), and 

b 

lg(t)| 1 |g(a)l + / |g(e)id9 
a 

< 1^(0) I + |F(a,c(.(0),(^)| + (b-a)^^^M. 

Therefore, from (3.10), 

iP^x.(g)|^</ ix{e;g)l^d9 
a-r 

■ if - lV(e)l^d9 + / Clf^(e,x(e;g), x^(g),...)| + m^(e)(l+r^'^^+v)L+ lg(9)l]^de 
-r d 
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for all t e [a,b] and g e I(c.M), where k = k(CsH) is finite since |g| and 
(using (H3)) the map (e,i|)) -»• f^(e,<l'(0),t|»,ii)(-r^),... , i{i(-r^)) is bounded (continuous) . 
over all ( 0 ,tj)) in the compact set {(t,x^(g))l te[a,b],g e 

IZI 

Lemma 3.5 Let x, = (4>(0),<^) be given in S, and let and z denoite the solutions 
to (3.4) and (3.5) respectively, correrponding to r, and g e A. Then, for any 
M>0., 

z'^(t-,c.g) ^ z(t-,?,g) as N -»- «> 
uniformly in g e I(?,M) and t e [a,b]. 

Proof . Let A^(t) = z^(t) - z(t). Then 

A*'*(t) = - C + / {A^(a)z^(o) - A(a)z(a) + P^^(g(a),0) - (g(a),0)}da. 

a 

We apply a commonly used result from analysis: If X is a Hilbert space and if 

x: [a,b] -> X is given by x(t) = x(a) + / v(a)da, then ix(t)|^ = jx(a)|^ 
t ® 

+ 2 / <x(a) ,v(a)>da (this is actually a restatement of the well-known result 
a 

[12, p. 100] that = <x(t) ,x(t)>) . It follows that 
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|A^(t)|f = 1(P^ - I'/Clf + 2 /''<A^(a)z'^{a) - A^(a)z{o).A^(a)> da 


+ 2 / <A (a)z(0) - A{o)z(a) ,A’’(a)> do 


+ 2 / <(P*^ - I)(g(a),0),A''*(a)>pda 

3i 


.N, 


1 1(P^ - I)c|p + 2 /”w(a) Ia'^(o) da 

d 

+ 2 / lA*^(a)z(a) - A(o)z(a)l lA^(a)j da 
a ^ p 

+ 2 - l)(g(a).0)l lA^'Ca)! da 

a p p 

b 

< I(P^ - Dci^ + / lA^(a)z(a) ~ A(c)z(a)|fda 

+ / 1(P^ - I)(g(cr) .0) l^da + / 2(w(a)+1 ) lA^Ca) l^da, 
a P a • • ^ 

2 2 N 

using 2ab _< a + b and tbe dissipative result for A^, An application of the 

Gronwall inequality establishes 

|A*'*(t)j^ _< [e,(N) + ep(N) + ep(N)] exp / 2(w(a)+l)da, 

p I ^ j - 


where 

e-,{N) = 1(P^ - Dtip , 

e2(N) ~ / lA^(a)z(a) - A(a)z(a) |^da, 
and 

e.(N) = / |(P''‘ - I)(g(a).0)|2da. 
a P 
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To demonstrate the desired convergence of 2 ^(t) to z(t) It suffices to show 
that e^(N) 0 as N •+ ®, uniformly in g e that the convergence is uniform 

in t is readily seen. 

From Theorem 4.1 of [10] we obtain the strong convergence of to I 
over Z. It is clear then that (N) -»■ 0 and that the integrand in e^CN) also 
converges to zero uniformly in g e I(c.M)- Uniform domination is established 
by calculating that 

|(P^ - I)(g(o).0)l2 < 4i(g{a),0)|2 . 4|g(o)l2 

P P 

1 4(Ig(a)| + / lg( 0 )|d 9 )^ 
a 

14(U(0)1 + iF(a,^( 0 ),i.)l , 

so that we may claim, using a uniform Dominated Convergence Theorem (see p. 241 
of [17]) that, for each M >_ 0, £ 3(^0 ->-0 ar N uniformly in g e I(cjM). 

M M 

Finally, to demonstrate the convergence of zero, we let (y^(f e Z 

represent P^z(a) = P^(x^( 0 ),x^) and observe that 

|A^(a)z(a) - A(a)z(a)|2 

= lP^A(a)(y^( 0 ),y^) A(a)(x^( 0 ),x^)l 2 

= |P^(f(a.y^( 0 ) ''’Pyj)- (F(cJ.x^( 0 ),x^).t)xJ |2 

< 2|P^(p(a.y^(0),yJ) - F(a.x^(0),x^).Py^ - 

+ 2 lP^(F(a.x^(CSx^).OxJ- (F(a,x^(Q),x^).DxJ |2 

£ f!^(a) + T^Ccr) + T2'(a), 
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where 

T!f{ 0 ) = 2lF(a.y^(0).y;;) - F(a,x^(0) ,x^) |2 . 

T^^(s) = 2v|Py” - . 

and 

T^(a) = 2lP^(f(a,x^(0),x^),OxJ - (f(<^.x^( 0) ,x^) ,Px^)|p . 

To complete the proof we demonstrate the dominated convergence of T^(a) -> 0 
uniformly in g e I(c,M), frequently applying the spline estimates given in Lemma 3.3 
(which are valid because c c S and g e I(c.M) implies that z(a) e S for all 
a E [a,b]). From (HI) and (3.8) we obtain, for M sufficiently large. 


T'j'(a) < 2m^^(a){!yJ[(n) - x^(0)l + \y^ - x^] + ’ x^(-r^ 


)1)' 




.2.. 1 2. 


whero lO^x (a.e. in a) for all g e Ifc,M) from Lemma 3.4. 

- I gl _ 

estimate in (3.7) establishes that, for N sufficiently large. 


T^j(a) 


2vk: 


\v\ 


? 2 
2vkok‘^ 


The spline 


so that we have, for almost all a e [a,b], 1 ^( 0 ) 0 and T 2 (ct) + 0 uniformly in 

g s I(':,M); in addition, 

T!j’(a) < 2m^(0)(l + r^^^ + v)^(k^ + r^^^k2)^k^ 


T2(o) 1 2vk^k^ 


so that each is dominated uniformly in g by an integrable function. Finally, 



TgCa) 0 as N ® for every 0 e [a.b] from the strong convergence of to I 
on Z. In fact, the converge ice Is uniform on V 5 Z, where 
V = i(F(a,x(a;g),x^(g)),Px^(g)^ I a e [a.b], g e is compact from 

Lemma 3.4(i). Uniform dominated convergence follows similarly since 

T’ 3 ('^) 5 8 |(F(a,x(a;g),x^(g)),I’x^(g)^lp 
2 

< 8 SUD |v| < ®. 

“ vev P 

!ZI 

Theorem 3.3 Let c = (4»(0),<|i) be fixed in W. Then 
z'^(t;c,g) ->• z(t;i:,g) 

as N « uniformly in g e A and t e [a,b]. 

Proof : Let e > 0 be given. From the uniform continuity of che maps 

(c,g) z(tic,g) 

(c,g) z^{t-,;,g), 

(uniform in t and H), 6 > 0 may be determined so that 

|z(t;c,g) - z(t;cg,gQ)lp -= e/3 

lz'''(t;5,g) - z'^(t;?Q.gQ) Ip < e/3 

for all t e [a.b] and N = 1,2,..., whenever ]c - Cq] <6, [g - g^j < 5. Since 
S is dense in.W we may select Cq = (<j>q(0) ,(J>q) e S that satisfies this condition. 
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In addition, it is a straightforward but tedious exercise to compute Mg (which 
depends on e, Cg, andK^, Kg from the definition of A) such that, for any g s A, 
we may construct gg e ICsq.Mq) that satisfies Ig-Sgl < 5. For example,’ for a given 
g, one might look for a function gg of the form 

9o(3) ~ ^0^®^ ■ F(a,^g(0),i^g), 


gg(e) = 


9o(a) 


+ [ 


g(T) - gg(a) 

T-a 


](0-a). 


g(9). 


a £ 6 £ T, 

T < 6 ^ b ; 


if Mg is chosen carefully (see pp. 76-78 of [14] for details) then it is not 
difficult to show that [ 9 g| £ Mg and |g-gg| < 5 so long as t is positioned 
appropriately in [a,b]. Therefore it follows from Lemma 3.5 that there exists 
Ng ^ 0 such that 


!z^(t;c,g) - z(t;c,g)|p 

1 |z^(t;c,g) - z^(t;cg,gg)|p 

Iz (t;5g,gg) - z(t;Cg,gg) 1^ 

+ |z(t;?g,gg) - z(t;c,g)|p < e 

for N ^ Ng. The convergence in the middle term is uniform in gge I(cg,Mg), so 
the choice of Mg depends on I(?g,Mg), i.e., on j; (through Cg) , e and a. It 
follows immediately that 

N 

z (t;c,g) -!> z(t;^,g) as N » 


uniformly in q e a and t e [a,b]. 


I 
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§3.2 Convergence of Optimal Controls 

In §3 we established the existence of an optimal control "u^ for each 
approximate control problem P^, and a solution z^CtjU^) = (x*'*(t;U^) ) to 
(3.2) associated withTi^. Our final result indicates whei. the approximate 
problem may be used to compute numerical solutions for the original control 
problem P. 

Theorem 3.4 Let (u } denote a sequence of controls in U where u is optimal 

for the approximating control problem P^. Then there is a control U e U and 
-K _w 

a subsequence lu of {u^} such that 

H. , 

(i) u - u in H'((a,b);R"’), 

_N. _ 

(ii) u ^ u in L2((a,b);R"'), 

N N. N N 

(iii) X *^(t;'u '') -+• x(t;ir) uniformly in t e [a,b], where x *^(t) = iigZ '^(t) 

and x(t) = iigZ(t) are the first components of the solutions to (3.2) 

and (2.5), respectively, 

N, _N. 

(iv) J ^(u ^) J(u) , and 

(v) u" is a solution to the original control problem P. 

M 

Proof : We first remark that, for any v e U, J (v) -*• J(v-)', this is trivially 

true because P^(k(0),ic) ■+ (k(0),<) in Z and z^(t;v) -+ z(t,v) in Z, uniformly in 

t e [a,b], from Theorem 3.3. 

N * N 

The sequence {u^} must have the property that [u^| £ M, for some H £ 0, 

_N. 

or there would exist a subsequence {u such that ju -*- =>, and thus 
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J (u ) -»• «, which contradicts the inequality 
J ■'(u £ J '^(v) ->• J(v) < » 

for any v e U. This result and the definition of U establish tf?at is 

1 iTl 

bounded in H ((asb);R ). We may therefore extract a weakly convergent sub- 

-^k _ 1 _ 

sequence {u } such that u ^ u in H , for some u e U, proving (i). The proof 

of (ii) is an application of Rellich's Lemma. To demonstrate the convergence 

needed in (iii)t we employ Theorems 2.2 and 3.3 to observe that 

N N N N 

jx ‘'(t;u - x(t;u)l < ]z '^(t;u - z(t;u)lp 

N N N N 

£ [z ’^(t;u ’^) - z(t;u + |z(t;u - z(t;u)|p -»• 0 

asNj,-»-» uniformly in t e [ajb], where convergence in the first term is uniform 

in ^ since BU e {g~Bv ) v e li, lv| £ H} c a. 

Finally, the weak lower semi continuity of J and the convergence of 
- _N. _N,^ 

z ^(t;u to z(t;u ) uniform in {u } may be used to demonstrate 

J(u) £ 21m J(u 

''k*" 

\ -"k 
= lim J "^(u n 

N. _N 

< lim J ^(u 

N|^-> “ 

N. 

1 lim J '^(v) 

= J(v) 



for any v e U. Thus, '•■.he control ueU must be optimal for the original control 
problem P. Repeating the same arguments with IT in place of v we also find 


J{u) 






§4 Numerical Results 

In the final section we present our numerical findings for a number of 
inertial control problems governed by functional differential equations. To 
illustrate the method developed in previous sections we chose examples that were 
representative of problems found frequently in applications or that were of special 
interest because of their difficult or commonly occuring nonlinear structure. 

In Example 4.1 we consider the problem of controlling the Mach number in the 
test chamber of the liquid nitrogen wind tunnel currently being built at NASA 
Langley Research Center. Problems with nonlinearities of the form sin(x)' and. 

X sin(x) are examined in Examples 4.2 and 4.3, where it iS interesting to note 
that performance of the spline approximations for each is excellent in spite of 
the fact that the second nonlinearity is only locally Lipschitz (and thus the 
FDE in question does not satisfy the hypotheses detailed above). In the control 
problem presented in Example 4.4, we consider a delay eqjiation with a nonlinearity 
of the Michael is - Menten type; such an equation is cormronly used to approximate 
velocity of reaction in models involving enzyme-mediated chemical reactions. 

The example also serves to illustrate convergence in models with point delays 
in the nonlinear part of the FDE, which would be important if one desired to 
model the transport (with a time lag r) of substrate/proriuct molecules in and 
out of a compartment where enzymatic reaction takes place. Finally, in 
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Example 4.5 we compare the spline-based approximation scheme to the averaging 
approximation method developed in [3], using an example from that reference. 
Although the control problem is not of inertial type, we are able to success- 
fully apply our method and demonstrate that the spline approximations exhibit 
better performance for this example. 

In the examples that follow we consider the open loop control problem of 
finding U £ U f {u G H^((0,T);R) | u(0) = 0} that minimizes 

(4.1) 0(u) = ^x(T)QqX(T) + y ^{x(t)Q^x(t) + u(t)Ru(t) + (u(t))^)dt 

where x satisfies 


(4,2) 




x(t) = ApX(t) + A^x(t-r) + F(t,x(t) ,x(t-r)) + Bu(t), 0 < t <_ T, 


^ Xq = !f> <3 H (~r,0) , 


'V 'Xi 


0 . 




and Aq, A^, Qq, and are n x n matrices, RG R, and B is a.i n x 1 matrix. To 

simplify our calculations we replace (4,2) by an equivalent delay equation in 

T 

the (n+1 )-vector y = (x,u) , 


(4.3) 


Kt) = Apy(t) + A^y(t-r) + F(t,y(t), y(t-r)) + Bv(t), 0 < t <_ T, 


where v(t) = u(t) is now treated as the control function; here the (n+l)-square 
matrices Ag and A-j are given by 


Ag B 


0 
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A, 


Of f 0® 


and 


B = 


where e is the zero vector in R . Similarly, the nonlinearity is defined to be 




F(t,x(t),x(t-r)) 


F(t,y(t),y(t-r)) = 


The cost functional associated with (4.3) may now be written as 

T 

(4.4) J(v) = I y(T)Qjjy(T) +- / (y(t)Q^y(t) + v^(t)}dt 


where 






Qn 9 


T 

0 0 


. Qi = 


9 


T “ 

0 R 


are (n+l)-square matrices. We turn now to the problem of determining a numerical 

solution for P^, the approximating control problem for (4.3), (4.4). From 

(3.3) and the discussion following Theorem 3.1, the approximate control problem 
— N 

is that of finding v that minimizes 

(4.5) J(v) = i wJ(T)QqwJ(T) + \ /{w^(t)Q^.^(t) + v^(t)}dv 




N N N N 

where ? is defined from the Z basis coefficients of P ( 41 ( 0 ) 4 ), and Q and 

N 

were given in §3. 

To obtain an optimal control 7^ (and the associated optimal trajectory Wg) 
for , we applied standard computational routines (such as gradient and con- 
jugate gradient schemes; see [23]) to necessary conditions for quadratic control 
problems governed by nonlinear ODE's (see [22], for example). All computations 
were executed on the CDC 6600 computer at Southern Methodist University, using 
a software package developed by Dr. D. Reber in 1977 while he was a student at 
Brown University. A full description of the optimization package and convergence 
criteria may be found in [3; Section 4]; integration of all ODE's was accomplished 
using Gill's modification of a standard fourth-order Runge-Kutta method. 

Since analytic solutions for these nonlinear problems are not available, 
an independent method of checking the validity of our results is desirable. 

To this end we worked directly with the FDE-governed control problem given by 
(4.3) and (4.4), and applied necessary conditions for optimality of delay 
system problems (detailed in Theorem VII. 2. 31 of [24]). If (y,V) is an extremal 
pair for (4.3), (4.4), the necessary conditions ensure that a multiplier 
X(t)€: R^^^ exists such that v maximizes 



(4.7) H * --Iv^Ct) + x(t){AQy(t) + A^y(t-r) + F(t,y(t), y(t-r))+ Bv(t)} 

( 1 .e .5 "v = 8x) and x satisfies 

| x(t) = - (Ag + 

- (A^ + 03 F(t+r,y(t+r),y(t)))^X(t+r) 

+Q^7(t), 0<t<T, 

X(T) = - Qg7(T), 

X(t) =0, t > T, 

where P-F denotes the derivative of F with respect to its component, i = 1,2,3 
Therefore, to solve the original control problem directly, we must solve a mixed 
advanced/delayed two-point boundary value problem (TPBVP) that consists of 
equations (4.3) and (4.8). For our purposes this was accomplished using one of 
the fourth-order block methods developed by Tavernini [29] for solving FDE's. 

We were able to construct an apprcximate numerical solution (y,v) to the original 
control problem by first integrating (4.8) backwards to obtain X (using the 
spline approximation Wg in place of y in (4.8)); we then used the method in [29] 
once again to integrate (4.3) forward in time to obtain y (substituting v = BX). 
One need then only check to see if x(T) ^ - QQyCf) to determine whether the pair 
(y,v) provides an adequate standard by which we may compare the spline approx- 
imations (Wg , v^'^). As will be seen in Examples 4.2 through 4.5, these values 

provide a rough, but independent, check on our approximate numerical solutions 
-N -N ^ 
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Example 4.1 Our first example is an open loop control problem motivated by 
the need to regulate the Mach number in the test chamber of the liquid nitrogen 
wind tunnel ■ (National Transonic Facility - NTF) under construction at NASA 
Langley Research Centar in Virginia. The NTF will be able to generate an air- 
stream that can reach a maximum of Mach 1.2 in speed, a feat accomplished through 
the use of high speed fans a..d nitrogen gas maintained at very low temperatures 
and high pressure. The liquid nitrogen that is sprayed into the tunnel upstream 
of the fan section acts primarily to regulate temperature, while pressure control 
is facilitated by venting nitrogen gas to the outside of the tunnel; Mach 
number is primarily regulated by fan motor speed, although subtle variations 
in Mach number are more easily controlled by making changes in inlet guide vanes 
in the fan section. These features of the wind tunnel are depicted in Figure 1. 


gaseous 

nitrogen 

vent 



Figure 1 
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To control the Mach number, wa first need an adequate .t® del for fluid flow in 
the tunnel and test chamber. Unfortunately, standard Navier-Stokes partial 
differential equations of fluid flow are extremely difficult to solve ccapu- 
tationally and thus would be of limited value when used in conjunction with the 
design of an optimal controller; a better alternative appears to be a lumped- 
parameter delay differential equation model [1] in which the delays represent 
transport lags of the fluid as it moves from one section of the tunnel to the 
other. In [1], a model of the relationship between Mach number and guide vane 
angle (GVA) is given by 

(4.9) TM(t) + M(t) = ke(t-r) 

where M(t) represents the perturbation of the Mach number from a given set point 
and 0 (t) is the perturbation of the GVA from a steady state' Sl7A. for this 
example, we will consider the regulation of Mach number from .8 to a set point 
of .P, so that the control problem consists of steering M(t) from an initial 
value of -.1 to the terminal value 0.0 in an efficient manner. The time delay 
r is approximately .3 sec and, with a Mach number sot point of .9, the con- 
stants k and t are given by -0.0117 deg'^ and 1.964 sec respectively. Change 
in GVA is initiated by a guide vane actuator; the dynamics of this process are 
approximated in [1] by the following ODE in 0 and 0^, where 0^ is the perturbati 
of the guide vane actuator from a steady state value: 

(4.10) 0(t) + 2cu>0(t) + w^9(t) = Jopit) . 

The constants ? and u are given by .8 and 6.0 rad/sec., respectively. For 
theoretical reasons discussed in [1], it is desirable to let the guide vane 
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actuator rate (0^) be the control variable v(t). Combining equations (4.9) and 

(4.10) we obtain a first order linear delay differential equation in 
x(t) = (M(t),0(t),0(t),0^(t))^, given by 

(4.11) x(t) = ApX(t) + A-|X(t-r) + Bv(t) 



and 

B = (0,0,0, 1)'''. 

Reasonable initial conditions for x are given by 
Xq = (-0.1, 8.517, e.O, 8.547), 

and a steady state value of 1.93 is given for both the SVA and the gu '-e vane 
actuator. For the Hach number control problem, the cost functional is ciiosen 
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to be 

1 2 

( 4 . 12 ) J(v) = ~ H^( 12 ) + i / {loV(t) + v^(t)}dt 
/ 0 

where v = L 2 (*' 0 , 12 );R). 

Although time-consuming (CPU time = 252 sec), the spline approximation for 
N = 6 gives excellent results when compared to the findings in [1], where the 
approach was to discretize (4.11) by finite-difference techniques. Graphs of 
the spline-based approximation for the optimal trajectories of Mach number and 
GVA may be found in Figures 2 and 3, where our findings are contrasted with 
those of [1]. 

Example 4.2 Consider the problem of finding u6 U that minimizes the cost 
functional 

J(u) = 1 x^(2) + 7 / u^(t)dt 

where IT and 7 = x(u’) satisfy 

x(t) = Y t^ sin x(t) + x(t-1) + u(t), 0 _< t £ 2, 

' 

<s>(0) = 1 . - 1 £ 0 _< 0. 

The results of our computations are summarized in Table 1, where we present 
approximate cost , the spline approximations x^ (for the optimal trajectory) 
and IT*'^ (for the optimal control), where M is taken to be 4, 8, 20 and 32. 

"True" extremals x and IT were generated from the TPBVP described in the intro- 
duction to this section, with 



Guide vane angle, degrees , f'*ach number 
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U) 

•- ■ u 



Time, seconds 
Example ^.1: Mach Number 
FIGURE 1 



Time, seconds 


Example 4.1: GVA 

FIGURE 2 
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Results for Example 4.2 


Time 


u8 


¥32 

u 

0.00 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.25 

-0,6674 

-0,6899 

-0.6873 

-0.6874 

-0.6858 

0.50 

-1.2200 

-1.2379 

-1.2327 

-1.2325 

-1.2291 

0.75 

-1.6453 

-1.6611 

-1.6551 

-1.6550 

-1.6494 

1.00 

-1.9674 

-1.9758 

-1.9726 

-1.9725 

-1.9645 

1.25 

-2.2056 

-2.1979 

-2.1995 

-2.1997 

-2.1891 

1.50 

-2.3681 

-2.3385 

-2.3462 

-2.3462 

-2.3332 

1.75 

-2.4558 

-2.4072 

-2.4226 

-2.4232 

-2.4087 

2.00 

-2.4786 

-2.-1239 

-2.4445 

-2.4453 

-2.4303 


Time 


CO 

(X 

¥20 

¥32 

X 

0.00 

1.0000 

1.0000 

1.0000 

‘ -1 .0000 ■ • 

T.OOOO 

0.25 

1.1634 

1.1631 

1.1633 

1.1633 

1 . 1636 

0.50 

1.1965 

1.1866 

1.1875 

1.1875 

1.1889 

0.75 

1.1314 

1.1174 

1.1195 

1,1194 

1 . 1 228 

1.00 

1.0168 

0.9957 

0.9981 

0.9979 

1 . 0041 

1.25 

0.8969 

0.8717 

0.8758 

0.8756 

0.8862 

1.50 

0.7926 

0.7727 

0.7756 

0.7754 

0.7927 

1.75 

0.7031 

0.6855 

0.6880 

0.6878 

0.7162 

2.00 

0.6223 

0.6097 

0.6088 

0.6085 

0.6564 

0^' 

2.4739 

2.4605 

2.4567 

2.4560 
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X(2) =1 


0.6080 

0.0 


Qoy(2) = 


0.6564 

0.0 
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as in the examples to follow, we see that the values of x and u calculated in 
this way are rough approximations to true extremals. 


Example 4.3 In this example, we handle a system containing a nonlinearity 
satisfying only a local Lipschitz condition, 'ihe problem is to minimize 

2 

J(u) = I x^(2) + I / (x^(t) + u^(t) + u^(t)}dt 
^ ^ 0 


-over.uS U subject to, . 


x(t) = x(t-l) + x(t) sin x(t) + u(t) 0 < t ^ 2 

<ji(0) = 10, -1 _< e £ 0. 

The spline approximations (x^,u*^), N = 2,4,8,16,32, for (x,u) are given in 
Table 2, with "optimal" values of {)T,U) determined from the TPBVP; in this 
example. 


X(2) = 


10.3444 

0.0 


- Qoy(2) 


10.3457 

0.0 
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Tima 

u ^ 




-32 

u 

u 

0.00 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.25 

-0.4320 

-0.4693 

-0.4794 

-0.4842 

-0,4882 

-0.4920 

0.50 

-0.81 20 

-0.8646 

-0.8714 

-0.8776 

-0.8832 

-0.8875 

0.75 

-1.1401 

-1.1767 

-1.1875 

-1.1943 

-1.2003 

-1.2039 

1.00 

-1.4280 

-1.4319 

-1.4421 

-1.4490 

-1.4549 

-1.4550 

1.25 

-1.6901 

-1.6699 

-1.6755 

-1.6808 

-1.6861 

-1.6798 

1.50 

-1.9371 

-1.9166 

-1.9118 

-1.9136 

-1.9177 

-1.9064 

1.75 

-2.1616 

-2.1571 

-2.1431 

-2.1409 

-2.1452 

-2.1334 

2.00 

-2.2910 

-2.2932 

-2.2807 

-2.2785 

-2.2840 

-2.2757 


T ime ■ 


, xV. 


-16 

X 

7^2 : 

X ■ 

0.00 

10.0000 

10.0000 

10.0000 

, 10.0000 

10.0000 

10.0000 

0.25 

10.4570 

10.4639 

10.4631 

10.4609 

10.4605 • 

10.4609 

0,50 

10.5118 

10.5018 

10,4959 

10.4949 

10.4941 

10.4938 

0.75 

10,4837 

10,4585 

10.4589 

10.4579 

10.4569 

10.4564 

1.00 

10.4490 

10.4279 

10.4204 

10.4167 

10.4149 

10.4140 

1.25 

10.4201 

10.4204 

10.4203 

10.4224 

10.4210 

10.4215 

1.50 

10.3933 

10.4095 

10.4135 

10.4114 

10.41 03 

10.4116 

1.75 

10.3658 

10.3787 

10.3765 

10.3784 

10.3776 

10.3793 

2.00 

10.3421 

■ 10.3428 

10.3457 

10.3452 

10.3444; 

10.3457 

Jf'' 

165.707 

165.700 

165.702 

165.694 

165.692 
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Example 4.4 We now consider a nonautonomous problem with a Michael is-Men ten 
type nonlinearity involving the point delay x(t-r). We wish to find u € U 
that minimizes 

2 

J(u) = i x^(2) +1 / u^(t)dt 
t z 0 

where IT and x satisfy 

x(t) = - tx(t) + u(t) , 0 < t < 2, 

< 

41(0) = 10, - 1 < 0 < 0 . 

V, — 


In this case, the numerical solution of the TPBVP yields x and u such that 


X(2) = 


1 , 0444 ■' 

0.0 


/- 1.0166 \ 

0.0 ) ' ■ 

the values of (x,IF) as well as the spline approximations ) for 

N = 2,4,8,16 and 32 are presented in Table 3. 


E xample 4.5 As a final problem we take Example 4.4 frca [3] and compare the 
averaging approximation method detailed there to the spliaae approximation scheme 
outlined in this paper. Although the control problem in question is not of in- 
ertial type (i.e., neither U nor the form of J requires btet u be bounded), we 
are still able to apply our method with success. The prcislem is to find 
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Time 

u2 




u32 

u 

0.00 

0.0000 

o.-oooo 

0.0000 

0.0000 

0.0000 

0.0000 

0.25 

-0.1429 

-0.1530 

-0.1576 

-0.1598 

-0.1611 

-0, 1620 , 

0,50 

-0. 2887 

-O.Sr'Sl 

-0.3091 

-0.3118 

-0.3137 

-0.3153 

0.75 

-0.4309 

-0.4478 

-0.4523 

-0.4549 

-0.4567 

-0.4590 

1.00 

-0.5629 

-0.5788 

-0.5847 

-0.5870 

-0.5882 

-0.5911 

1.25 

-0.6782 

-0.6966 

-0.7027 

-0.7044 

-0.7050 

-0.7084 

1.50 

-0.7704 

-0.7953 

-0.8013 

-0.8024 

-0.8024 

-0.8060 

1.75 

-0.8324 

-0,8641 

-0.8713 

-0.8722 

-0.8720 

-0.8758 

2.00 

-0.8573 

-0.8901 

-0.8987 

-0.9001 

-0.8999 

-0.9037 


Time 

72 

7^ 

7^ 

7^6 

722 

X 

0.00 

10.0000 

10.0000 

10.0000 

10.0000 

10.0000 

10.0000 

0.25 

9.7467 

9.7291 

9.7207 

9.7178 

9.7171 

9.6915 

0.50 

8.9221 

8.8599 

8.8405 

8.8356 

8.8340 

8.7874 

0.75 

7.6345 

7.5383 

7.5170 

7.5108 

7.5088 

7.4489 

1.00 

6.0770 

5.9843 

5.9646 

5.9587 

5.9566 

5.8925 

1.25 

4.4723 

4.4159 

4.4012 

4.3967 

4.3950 

4.3345 

1.50 

3.0157 

3.0050 

3.0001 

2.9984 

2.9976 

2.9464 

1.75 

1.8363 

1.8612 

1.8671 

1.8690 

1.8692 

1.8297 

2.00 

0.9837 

1.0277 

1.0407 

1.0437 

1 . 0444 

1.0166 

3^' 

0.6956 

0.7548 

0.7726 

0.7767 

0.7777 
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J(u) = 1 x 2(2) + ~ / {x^(t) + u^(t)}dt 
0 

subject to 

x(t) = x(t) sin x(t) + x(t-1) + u(t) , 0 £ t £ 2, 

flO(0+l), -1 < 9 < -0.5, 

4.(0) = - - 

[^-10 0 , - 0. 5 £ 0 £ 0 . 

From Tables 5 and 6 of [3] it is evident that the averaging scheme works quite well, 
but, as we shall demonstrate, the spline-based method exhibits even better per- 
formance for this example. At this point we wish to remark that the "true" 
extremals (x.IT) used for comparison in [3] were determined from the TPBVP, where 
an incorrect version of Tavernini's block method was used to integrate the 
delayed-advanced equations (in fact, the error is a misprint on p. 793 of 
Tavernini's original paper [29] where, in the fourth line of the calculations 
•for x^Cs), 2Fj^ and 4F^ should be separated by a minus sign). In this particular 
example the errors involved are slight; they are more substantial for Example 4.2 
of the same reference. 

— N — N 

In Table 4, the averaging aporoximations x^y^ and u^y^ are given for 

N = 8 and 32. Similarly, we provide results for the spline-based method by 

— N — M 

summarizing our findings for x^pj^, '' 5 p|_> ii = A, 8, and 32. Both are compared 
against "optimal" solutions x and u (using the correct version of Tavernini ' s 
method), where, from the TPBVP, it is determined that 

a( 2) = u(2) = - 0.3230 
and 

- x(2) = - 0.3053. 
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Results for Example 4.5 


Time 

“ave 

*^AVE 

—4 

“SPL 

“SPL 

-32 

«SPL 

u 

0.00 

-2.3083 

-2.3032 

-2.3331 

-2.3024 

-2.2967 

-2.3028 

0.25 

-2.1804 

-2.2706 

-2.3707 

-2.3230 

-2.3101 

-2.3164 

0.50 

-1.9855 

-2.1972 

-2.2820 

-2.3034 

-2.3126 

-2.3189 

0.75 

-1.5751 

-1.6908 

-1.6921 

-1.7294 

-1.7424 . 

-1.7470 

1.00 

-1.1446 

-1.1318 

-1.0787 

-1.1002 

-1.1037 

-1.1031 

1.25 

-0.8173 

-0.7697 

-0.7160 

-0.7427 

-0.7497 

; -0.7483 

1.50 

-0.5967 

-0.5667 

-0.5727 

-0.5644 

-0.5624 

-0.5619 

1.75 

-0.4401 

-0.4327 

-0.4978 

-0.4591 ■ 

-0.4451 

-0.4440 

2.00 

-0.3125 

-0.3147 

-0.3960 

-0.3496 

-0.3265 

-0.3230 

Time 

^AVE 

-32 

"ave 

^SPL 

7^ 

^SPL 

“32 

^SPL 

7 

0.00 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.25 

-0.1062 

-0.2056 

-0.2457 

-0.2414 

-0.2445 

-0.2473 

0.50 

0.1351 

0.1245 

0.1377 

0.1123 

0.1104 

0.1078 

0.75 

0.3456 

0.4917 

0.5717 

0.5895 

0.5725 

0.5663 

1.00 

0.4120 

0.5550 

0.6459 

0.6175 

0.6267 

0.6186 

1.25 

0.3805 

0.4232 

0.3902 

0.4099 

0.4204 

0.4127 

1.50 

0.3269 

0.2966 

0.1737 

0.2447 

0.2582 

0.2474 

1.75 

0.2988 

0.2644 

0.2079 

0.2420 

0.2404 

0.2272 

2.00 

0.3106 

0.3115 

i 

0.3699 

0.3289 

0.3230 

0.3053 

0^ 

2.177 

2.401 

2.541 

2.523 

2.523 


CP Time 
(sec) 

31.87 

72.39 

19. 98 

49.42 

125.27 
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From Table 4 it is evident that the spline approximation for N = 4 is generally 

better than the averaging approximation for N = 8, at a considerable savings in 

CP time. A similar comparison may be made between and , 

—32 

One should note however that, for the same value of N, computing 
solutions via the averaging method is much less costly than by the spline-based 
scheme, although at a loss in accuracy. Analogous statements may be made about 
a comparison between the averaging and spline methods for Example 4.3 of [3], 
which is identical to this example except that the initial function is the 
constant function ^ = 10. It is clear then that the observations made here 
reflect more than the possibility that a nonconstant <l> is better approximated 
by splines than by averaging schemes. The two methods performed equally well 
when applied to Example 4.2 of the same reference. 


§5 Concluding Remarks 

The convergence proofs constructed in §3, together with the convergence 
results obtained in practice lead us to conclude that our method is indeed a 
reasonable approach to take in the solution o^ hereditary control problems, 
performing better than the averaging approximations of [3] in some of the 
examples we have tried. In addition, the spline-based schemes appear to offer 
a somewhat inexpensive alternative to existing numerical algorithms in that 
approximating systems as small as N = 2 or 4 provided satisfactory solutions to 
many of the control problems we tested. 

In future efforts we hope to investigate the possibility of relaxing some 
of the hypotheses made in §3 (in particular, the global Lipschitz criteria) 
and to make comparisons between our method and the approach taken in [25], [26], 
where a full discretization of the FDE control system is examined. 
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